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Primal robustness and semidefinite cones 


Seungil You, Ather Gattami, and John C. Doyle 


Abstract — This paper reformulates and streamlines the core 
tools of robust stability and performance for LTI systems using 
now-standard methods in convex optimization. In particular, 
robustness analysis can be formulated directly as a primal 
convex (semidefinite program or SDP) optimization problem 
using sets of gramians whose closure is a semidefinite cone. 
This allows various constraints such as structured uncertainty 
to be Included directly, and worst-case disturbances and per¬ 
turbations constructed directly from the primal variables. Well 
known results such as the KYP lemma and various scaled small 
gain tests can also be obtained directly through standard SDP 
duality. To readers familiar with robustness and SDPs, the 
framework should appear obvious, if only in retrospect. Bnt 
this is also part of its appeal and should enhance pedagogy, and 
we hope suggest new research. There is a key lemma proving 
closure of a grammian that is also obvious but our current 
proof appears unnecessarily cnmbersome, and a final aim of 
this paper is to enlist the help of experts in robnst control and 
convex optimization in finding simpler alternatives. 

I. Introduction 

Robust control theory has been an important subject in 
the control engineering both in theory and practice [1]. 
Theoretical developments has been evolved in various flavor, 
but the most modern approach to this subject is the Linear 
Matrix Inequality (LMI) based approach [2]. 

In order to obtain the LMI characterization of system 
behavior, so called the 5-procedure [3] has been extensively 
used. Motivated by the popularity of LMIs in systems theory, 
semidefinite programming (SDP) duality has been used to 
understand such LMIs and control theoretic interpretation of 
the SDP duals of these LMIS has been reported [4], [5], [6]. 
In particular, the dual LMI approach is used to extract the 
worst case frequency variable and disturbance in [5], [6]. 
However, a recent paper shows that this dual LMI has its 
own right as a well-defined optimization when it comes to 
T-Lao analysis [7]. In [8], we also report that the Kalman- 
Yakubovich-Popov (KYP) lemma [9] is an SDP dual of 
this optimization problem, which should be obvious to the 
experts. An interesting observation in here is that the dual 
LMI may be another starting point of robustness analysis 
which does not require 5-procedure, and well known results, 
such as the KYP lemma can be obtained through SDP 
duality, i.e., reversing the theoretical developments. 

To this end, this paper provides a complete character¬ 
ization of gramians generated by a linear time invariant 
(LTI) system. It turns out the closure of a set of gramians 
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is an intersection of a subspace and a semidefinite cone. 
The seminal paper [10] attempts to obtain similar results on 
the covariance matrices generated by stochastic disturbances, 
but this paper characterizes gramians from deterministic 
disturbances, which is suitable for existing robustness results. 
More importantly, we provide a semidefinite representation 
of gramians in contrast to the rank constraint in [10]. This 
semidefinite representation allows us to formulate extended 
"Hoc analysis, where we can directly capture numerous prior 
information on the disturbance including structural proper¬ 
ties, as an SDP. 

In addition, the SDP dual of our primal optimization 
provides the well known LMI characterization of the sys¬ 
tem behavior. We exemplify this procedure for the KYP 
lemma, but the result can be easily extended to more general 
disturbance setting, and our approach provides an arguably 
simple proof through standard SDP duality. In addition, SDP 
duality also provides the scaled small gain tests for the 
robust stability verification. However, our primal formulation 
provides a specific input-output pair proving that the system 
is not robustly stable, which is not a trivial task in the 
scaled small gain test. This is because the variables in the 
scaled small gain test does not contain useful input-output 
information, so if the test fails, it is hard to extract a specific 
pair that disproves robust stability. This entire procedure of 
obtaining LMIs for robustness analysis should be obvious 
to the experts, which shows a pedagogical benefit of our 
approach. We also hope that our new tool opens up a new 
research direction in robust control theory. 

A. Notation 

are sets of n x n Hermitian, positive 
semidefinite, positive definite matrices, respectively. The 
generalized inequality X ^ 0 means X G H+, and X y 0 
means X G H++. We use I 2 for (2[0,c»), the Hilbert space 
of square summable sequence with the starting index 0. The 
bold Latin letter x means a sequence in ( 2 - In addition, for 
a vector and vector-valued signal, 11-112 is the two norm. For 
a matrix and linear operator, || • ||i? is the Frobenius norm, 
and p{A) denotes the spectral radius of A, A* denotes a 
Hermitian/Adjoint operator. 

11. A SEMIDEFINITE REPRESENTATION OF GRAMIANS 

For a signal u G I 2 , we define the gramian A : I 2 ^ IHI+, 

00 

A(u) = '^Ukul. 

k=0 

Notice that the gramian is well-defined because each entry 
of the matrix is finite, and EI+ is closed. 


For notational convenience, let A(u,v) = A 
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E oo 

k—0 
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_Vk 


Vk 



V-1 


, and AAr(u) be a finite truncation of A, 


Suppose we have matrices A G C"^", B G where 

A is Schur stable, p{A) < 1, and let M : be a 

linear operator such that x = Mw if 


Xk+i = Axk + Bwk 
xo = 0 . 


( 1 ) 

( 2 ) 


In this paper, we consider a set of gramians, S, generated 
by M, 

S := {V G H+ : V = A(Mw, w) for some w G ^2} ■ 


In terms of x, w, the gramian can be seen as 


'X R' 


Ek ^kXl J2k XkWl 

R* W 


Ek 'WkXl J2k WkWl_ 


From this definition, we can easily see that the gramian 
captures various input-output relationships in the system. 
For example, ||w|[| = Tr and HCx -f I?w||| = 

'C*C C*D\ 


Tr 


D*C D*D 


V 


However, for a given matrix V, checking F G 5 is not 
a trivial task, because one should search over the I 2 space, 
an infinite dimensional space, to find a signal w generating 
V. Therefore it is desirable to find a convinient way to 
characterize the set S. Let us consider the following set 


C := 


|l/G H+ 








Notice that C is an intersection of a subspace in HI and 
a semidefinite cone, therefore C is a finite dimensional 
closed, convex cone that is semidefinite programming (SDP) 
representable. This means that checking V € C can be easily 
done by a semidefinite programming. 

Why do we need this set C? Is there any relationship 
between C and S? The following proposition shows an 
interesting observation between these two sets. 


Proposition 1: The set S is a subset of C. 


Proof: Suppose V € S. This means there exists a signal 
w G ^2 such that V = A(Mw,w). Let x = Mw. Then, 
since Xk+i = Axk + Bwk, we have 

Xfc+iXfc+i = [A B] 

By taking an infinite sum, we have 
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Moreover, since xq = 0, Y,'^=oXk+lxl_^_l = Y^'^^oXkxl- 
Using this fact with [/„ 0n,m\ V [/„ 0n,m] * = 

^kX%, we can conclude that U G C. ■ 


The above observation is somewhat trivial due to the 
convergence. But the immediate, and important question 
arises. Is C equal to SI If this is true, we can replace a 
complicated set 5 by a semidefinite representable convex 
cone C. For an optimization with S, this has a dramatic 
impact; any optimization involving S becomes a convex 
program. Unfortunately, this is not the case. 


Example 1: Let A = a, B = 1, where |a| < 1, and a f 0. 


Consider V = 


1 — a 
1 


1 — a 

1 


. It can be easily checked V G 


C, and Rank {V) = 1, but V ^ S. 


However, we have a surprising fact: C is the closure of 
S. Although the idea of the proof is simple, but our cuiTent 
proof goes through a tedious analysis to apply the e — 5 style 
argument. So we present the main result here, and relegate 
the sketch of the proof to the appendix. But we want to 
emphasize that our proof is constructive, therefore given V, 
we can find a signal w that approximates V arbitrarily close. 


Lemma 1: Suppose V 


X R 
R* W 


G C. Then for all e > 


0, there exists w G ^2 with finite number of non-zero entries 
such that 


||A(Mw, w) — U||_F < e (3) 

A(w) = W (4) 


The following is immediate. 

Lemma 2: C = cl 5. 

Proof: From Proposition [T] S C C, which shows cliS C 
C since C is closed. From Lemma [T] C C cl 5. Therefore, 
C = cl5. ■ 

The above two results are key lemmas in this paper. Many 
robustness analysis can be stated as an optimization problem 
with gramians, that has a linear objective function. Therefore, 
a set of gramians, S, can be replaced by C without any 
conservatism, and more importantly the resulting problem 
becomes an SDP. 

Before concluding this section, we present a connection 
between the controllability of (A, B) and the geometric 
property of the SDP cone C. 

Proposition 2: There exists V £ C D IHI++ if and only if 
(A, B) is controllable. 

Proof: Suppose (A, B) is controllable. Since A is 
stable, the controllability gramian Wc 

AWeA* - Wc + BB* = 0 

is positive definite. Let 

0 jj ’ 

then U G C n IHI++. 

Now suppose there exists U G C fl IHI+. Since V £ C, 

AX A* -X-h BR*A* + ARB* -h BWB* = 0. 










































Let W = TT*, and B = BT, K = T-^R*X-^. Then, 

{A + BK)X{A + BK)* -X + BB* = 0. 

Since X 0, {A + BK, B) is controllable, and it is easy to 
check that {A, B) is controllable. ■ 

Now we use all these results to prove well-known results 
in robust control theory which shows the effectiveness of our 
new, primal approach. 


III. Hoc ANALYSIS AND THE KYP LEMMA 
A. Hoc analysis 

In Hoc analysis, we would like to find the worst-case 
disturbance that maximizes the output norm. Specifically, let 
Zk = Cxk + Dwk- Then we want to solve 


p-oo :=maximize 


subject to Xk+i = Axk + Bwk, 

llwlln = 1. 


Xq 


= 0 (5) 


The optimal value of Q is the square of the Hoc norm of 
the system. 

'y: R 
R* W 


Let A(Mw, w) = 
Notice that 


where X G H", W G 


= Tr 


C*C 

D*C 


C*D 

D*D 
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= Tr(IL). 


This shows that the optimization Q is equivalent to 


maximize 

X,R.W 


Tr 


subject to 


C*C 

D*C 

R 
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C*D 
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( 6 ) 


X 
R* 

Tr(W) = 1. 

However the above problem is hard to solve because the 
feasible set S is involved with an infinite dimensional, I 2 
space. Using Lemma [T] and |2l we can replace 5 by C which 
results in an SDP that computes the Hoc norm of the system. 

'y: R 


Proposition 3: Define the set H = {V = 
Tr {W) = 1}. Then cl(5 AF)^Cr\T. 


R* W 


Proof: Since cl 5 = C, and clJ^ = we have 
cl (5 n C CAJ-. Now suppose V G CDJ-. From Lemma 
[H for any e > 0, there exists w G I 2 such that A(w) = 1, 
and IIU — A(Mw, w)||i? < e. Since A(Mw, w) G 5 fl 
we can conclude that V G cl(5 fl H). ■ 

Therefore, from the continuity of Tr (•), we can replace 
5 in (|6l) by C without any conservatism, and this is the main 
reason why we can compute the Hoc norm using an SDP. 


maximize 

X,R.W 
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t 0,Tr (lU) = 1. 


(7) 


Clearly, the above optimization is an SDP that can be 
solved via a standard SDP solver [11], and has the same 
form as [7], [8]. More importantly, without going through 
an additional proof, we can easily check the equivalence 
between the finite-dimensional SDP (|2| and an infinite¬ 
dimensional optimization (|6]l. Notice that after obtaining the 
optimal solution of (|7]i, we can construct a signal w that 
asymptotically achieves the optimal value using the proof of 
Lemma [U This direct formulation approach will be repeated 
through this paper, and our Lemma [T] provides a elementary, 
yet elegant approach to the classical problems in robust 
control theory. 

Using SDP duality, we can expand our understanding of 
(|7]i. The following is the SDP dual of (|7]): 


minimize 

AeK.PeH 

subject to 


A (8) 


'A 

B 


P 

O' 


'A 

B 

-A 

'0 0 ■ 

C 

D 


0 

I 


C 

D 

0 Im 


which is the same problem derived from the KYP lemma. 
Since we provide a well-defined optimization using our set 
C, we can claim that the KYP lemma is the dual of Hoc 
analysis. In addition, we can easily check that strong duality 
holds between © and ® because the dual program ® is 
strictly feasible. 

Proposition 4: ® is strictly feasible. 


Proof: Since A is stable, there exists P such that 
A* PA — P + C*C -< 0. Then by taking A large enough, 
we can find a strictly feasible point of ■ 

As a result, we have the following corollary from the 
Conic duality theorem [12]. 

Corollary 1: The duality gap between ©, ® is zero, and 
the primal problem © is solvable. 


However the dual optimum may not be attained. Let us 
see the following example. 


Example 2: Let A = ^,B = 0,C = 1,D = 1. Then the 


optimal solution of © is given by V* 


0 0 
0 1 


and the 


corresponding optimal value is -|-1. The optimal value of the 
dual is also -fl, by taking X* = 1, and P* —> 00 . Clearly, 
the dual optimum is not attained. 


The pair (A, B) in the above example is not controllable, 
and this phenomena is closely related to the controllability 
assumption in the KYP lemma. In order to ensure the 
existence of a multiplier P (a dual optimal solution), we 
need the controllability assumption. 

Proposition 5: The primal program © is strictly feasible if 
and only if {A, B) is controllable. 

Proof: From Proposition |2] there exists U G C G IHI+ 
if and only if {A, B) is controllable. ■ 

As a corollary, we have the following result on strong 
duality. 




































Corollary 2: Suppose (A, B) is controllable. Then both the 
primal problem 0 , and dual are solvable. 

B. A proof of KYP lemma 

Based on the observation between the KYP lemma and 
our primal optimization, it is very easy to prove the KYP 
lemma using the theorem of alternatives for SDP [4]. 

Let A, B linear operators on H. Then, 

Theorem 1 (ALT4): Exactly one of the following is true. 

(i) There exists an X £ W with A{X) + Aq Y 0, and 
B{X) = 0. 

(ii) There exists a non zero Z G W G H, A*{Z) + 
B*{W) = 0, and Tr (AqZ) < 0. 

Now we are ready to prove the following theorem. 

Theorem 2 (KYP lemma, strict inequality): The optimal 
value of Poo < 1 if tind only if there exists P G H” 
such that 

'A* PA - P A* PB 
B*PA B*PB 


C*C C*D 
D*C D*D - 


^0. (9) 


Proof: From the Theorem [H there exists P with 
holds if and only if there is no non-zero V P 0 
such that [A i?] C [A B]* — [/ O] F [/ O]*, and 


Tr 


C*C 

D*C 


C*D 
D*D- I 


y ) > 0. Notice that this is equiv¬ 


alent to the optimal value of 0 is greater than equal to 1 , 
since the optimum is always attained. Since 0 is equivalent 
to 0 , we can conclude the proof. ■ 


Theorem 3 (KYP lemma, non-strict inequality): 

Suppose {A, B) is controllable. Then poo < 1 if ond 
only if there exists P G H" such that 

'A* PA - P A*PB 
B*PA B*PB 


C*C C*D 
D*C D*D - I„ 


A 0 . ( 10 ) 


Proof: If Poo < 1, then from the Theorem [3 the result 
is obvious. Suppose the optimal value of 0 is 1. Then the 
optimal value of 0 is also 1. From the Corollary |2] this 
is equivalent to the existence of the dual optimal solution 
(A, P) = (1,P*), and this concludes the proof. ■ 

IV. Extended Hoo analysis 

In Poo analysis, a disturbance w is assumed to have 
an unit energy, ||w ||2 = 1. Suppose more information 
about a disturbance is known beforehand. Then Poo norm 
becomes conservative since the analysis does not exploit 
this additional information. Therefore, it is natural to ask 
a question whether we can capture more general disturbance 
sets beyond ||w ||2 = 1 , and formulate appropriate Poo 
optimization. In this section, we propose extended Poo 
analysis with different constraints on the disturbance. Some 
of these results are known from [13] in the form of the scaled 
small gain test, but we explicitly propose a well-defined op¬ 
timization problem which contains a disturbance information 


which allows us to extract the worst-case disturbance, and 
provide its exactness without additional effort. 

Now consider the following disturbance set. 

W = {w e (2 : fi (A(w)) A 0, i = 1, • • • , ric} , 

where each fi is a matrix valued linear function maps H to 
H. This set can be used to capture some interesting prior 
knowledge on the disturbance. 

Example 3 (Poo analysis): In the Poo analysis, we re¬ 
quire ||w ||2 = 1. Using fi(W) = Tr (IK) — 1, f 2 {W) = 
1 - Tr (IT), then, 

W = {w e (2 : Tr (A(w)) = ||w ||2 = l} , 
which is desired. 


Example 4 (Square Poo analysis): In [13], the distur¬ 
bance w satisfies ||wi ||2 < 1, for i = 1, • • • ,m, where 
is the ith component of w. Using fi(W) = Wu — 1, for 
i = 1, - ■ ■ , m, then, 

yV = {vr Gh - fi (A(w)) = ||wi ||2 < l,i = I,- - • ,m} , 
which is desired. 


Example 5 (Grouped square Poo analysis): Suppose the 
disturbance is in and ||wi ||2 -f IIW 2 II 2 < 1 , IIW 3 II 2 -f 
IIW 4 II 2 < 1. Then using fi{W) = ITn-f IT 22 — 1, f 2 iW) = 
W 33 -\- W44 — 1, we can capture this disturbance. 

Example 6 (Principal component bound): Suppose we 
know that the maximum eigenvalue of the autocovariance of 
the signal w is bounded by one. This can be easily captured 
by fi{W) = W — Im- and W = {w G (2 : A(w) ^ Im}- 
See [14] and references therein for the application of this 
disturbance modeling. 

These examples show that our modeling framework can 
capture various information on the disturbance. Now the next 
step is to find a computationally tractable method to analyze 
the worst-case performance as in the Poo case. In other 
words, we would like to find a way to solve the following 
infinite dimensional optimization. 

maximize HCx-f iAw ||2 

W,X 

subject to Xk+i = Axk 3-Bwk,XQ = 0 
w G W. 


Using the Gramian V = 


X 

R* 


R 
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= A(Mw,w) as in the 


Poo analysis, the above optimization is equivalent to 


maximize Tr 

X,R,IV 

subject to V = 


'C*C C*D 
D*C D*D 

X R 
R* W 

MW) p 0 , 
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R* 


G S 

i = I,--' 
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( 12 ) 


In Poo analysis, we replace 5 by C which is an SDP 
representable set. For (Ell, we can also apply the same 



















procedure. The following proposition can be seen as a A. The plant G is said to be robustly stable with respect to 
generalization of the Proposition |3] A if 


Proposition 6; Let fi : HI —^ H, i = 1 • • • , ric, 

r X 

linear function. Define the set T = {V = 


be the 
R 
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H : fi{W) ^ 0, i = 1, • • • , Tic}. Then cl(5 fl = C fl 


Proof: Since cl 5 = C, and clJ^ = R, we have 


cl (5 n c C r\ T. Now suppose 


X R 
R* W 


e c nR. 


From Lemma [U for any e > 0, there exists w G h such 
that A(w) = W, and \\V — A(Mw,w)||ir < e. Since 
A(Mw, w) G 5 n we can conclude that V G cl(5 fl R). 


Therefore, the optimization (fT^ is equivalent to the fol¬ 
lowing SDR 


maximize 

X,R,W 
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(13) 


I - AG, 


is non-singular for all A G A. See [1] and references therein. 

In this section, we investigate the possible connection 
between the robust stability analysis and our key Lemmas, 
Lemma [T]and|2] 

To begin with, we assume that the uncertainty set A 
admits the equivalent input-output characterization [16], [17], 
that is, there exists a set TZa such that 


TZa ■= {(z,w) : There exists A G A such that w = Az}. 

Moreover, we assume that TZa can be completely charac¬ 
terized by a linear map, i.e., there exists / : HI —>■ HI such 
that (z,w) G TZa if and only if 

/(A(z,w)) ^ 0. 


Let A(z,w) = 


R* 


R 

W 


, then the following examples 


show that how / can be used to describe TZa- 


Example 7 (Full block complex LTV): Suppose A = 
|A : ||A|| < 1|. Then (z,w) G TZa if and only //llwlU < 
||z|| 2 . Therefore, /(A(z,w)) = Tr (Z) - Tr (IV). 


Notice that as in the Tioo analysis case, once the optimal 
solution of dS) is obtained, we can explicitly construct 
the worst case disturbance w (approximately) achieves the 
maximum value, and this is not available in [13]. 

Moreover, it is easy to derive the dual program using SDP 
duality and the KYP lemma like result can be obtained for a 
given disturbance set. For example, applying the Theorem [T] 
to the Example m the square Tiao analysis, the optimal value 
of dol l is less than 1 if and only if there exists P, Y such 
that 


Y Y 0 
Tr (Y) < 1 

'A* PA - P A* PB 
B*PA B*PB 

where Y is a diagonal matrix. Notice that this result can 
also be found in [13], but the proof in here is significantly 
simplified. 

Some of these results may be obtained obtained through 
the 5-procedure, but proving the 5-procedure is lossless 
is not a trivial task [15]. However, our approach shows 
that the 5-procedure can be viewed as a SDP relaxation of 
([T 2 I 1 . This idea may trace back to [5], but the direct, primal 
formulation of the problem firstly appears here to the best 
of our knowledge. 

V. Robust stability analysis 

The robust stability analysis investigates the stability of 
the feedback interconnection between the nominal plant G, 
a bounded operator from I 2 to I 2 , and the uncertain operator 
A, a bounded operator from I 2 to I 2 , which belongs to a set 


C*C C*D 
D*C D*D-Y 


/(A(z,w)) = 


,||Ai|| < 1}. Then 


Example 8 (Two block complex LTV, [18]): Suppose 

^ ^ = [^0^ aV 

(z,w) G TZa if cind only if irwi ||2 < INilb. cind 
IIW 2 II 2 < 11^2 II 2 , where are appropriately 

partitioned according to the size of A^. In this case. 

|■Tr(Zl)-Tr(lYi) 0 

0 Tr(Z2)-Tr(fY2) 


Example 9 (Scalar block complex LTV, [19]): Suppose 
A = {A : A = 51, ||5|| < 1}. Then (z, w) G TZa if and only 
if A{w) A A(z). Therefore, /(A(z, w)) = Z — W. 


Example 10 (Integral quadratic constraints, [20]): 

Suppose (z,w) G TZa if and only if 
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This is equivalent to 


Tr 
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R* 



> 0 . 


Notice that using this set description of TZa, we have 

(I - AG)w = 0 
w = AGw 
(Gw,w)g7^o, 

This means if there exists ||w|| = 1 such that (Gw,w) G 
TZa, then G is not robustly stable. Therefore it is natural to 
consider the following set of values generated by Q: 

G ■= {/(A(Gw,w)) : ||w|| = 1}, 
































then we can easily see that Q fl IHI+ ^ 0 is the equivalent 
condition for the existence of || w|| = 1, such that(Gw, w) G 
TZa- In other words, C/nIHI+ ^ 0 then the system G cannot 
be robustly stable. 

Therefore we can change the robust stability question to 
a set relationship question, but characterizing Q may not 
be trivial. However, if G has a state-space form such that 
X = Mw, and z = Cx + Dw, then we have the following 
proposition which is a direct consequence of our main result. 


Proposition 7: Suppose G{e^^) = — A) + D. 

Then the closure of Q is given by 


cig = {f 
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0 I 


X R 
R* W 


Tr (VF) = 1, 


C D 
0 / 
X R 
R* W 


eC 


Proof: Let M = I — A) Then, z = Gw = 
CMw + Dw. Now 


A(Gw, w) = A(GMw + Dw, w) = A 
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Tr(IL) = 1, 


R* 


R 
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G 5 
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Recall that cl 5 = C. Using the continuity of /, we can 
conclude the proof. ■ 

Since C is an SDP representable cone, the above charac¬ 
terization is much easier to handle compared to Q. In fact, 
using the theorem of alternatives, we can obtain the very 
interesting LMI characterization of cl C/ fl H+ 0 . 


Theorem 4 (ALTSa): Exactly one of the following is true. 

(i) ziX G H such that A{X) ^ 0, A{X) 0, and B{X) = 

0. 

(ii) 3Z G lU G H, such that A*{Z) + B*(W) = 0. 


Proposition 8: Exactly one of the following is true. 

(i) cig r\M+ = 0 . 

(ii) There exists P G H, U 0 such that 
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0 I 


Proof: Let 
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B(V) 
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[A B]V [A B]* - [I 0]V [I 0]*. 


Then clQ D IHI+ = 0 if and only if there exists V such that 
A{V) > 0, but A(V) 0, and B{y) = 0. We can resale 


V, if necessary, to satisfy the trace condition. Notice that the 
adjoint of the right bottom block of A{y) is given by 


{Y,iA{V)h 2 )=Tr{Yf 
Tr (r{Y) 


'c 

D 

V 

c 

D 

0 

I 

0 

I 


= Tr 


C D 
0 I 


r{Y) 


C D 
0 I 


C D 
0 / 


V 


V 


C D 
0 / 


Using this fact with Theorem @1 we can conclude the proof. 


The above Proposition is indeed very interesting. It 
presents the equivalent LMI characterization of separating 
two sets. Let us apply the above result to the previous 
examples of A. 


For Example |7] f{V) = Tr 


I 

0 


0 

-I 


V], and riy) = 


yi 0 
^ 0 

condition (O becomes 


, where the domain of /* 


In this case. 


A 

B' 

* 

'P 

0 ■ 


'A 

B' 
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-p 


0 

I 

_ 1 _ 

C 
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* 

'yi 
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■ 

'C 


0 
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0 - 

-yi_ 
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D 
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^0, 


and since y > 0, by multiplying 1 /y to both sides, we recover 
the KYP lemma for ||G||oo < 1. 

For Example IH /(U) = [/ O] U 


-[0 I]V 


Y 0 
0 -Y 

In this case, condition (fl4li becomes 


and r{Y) = 


, where the domain of f* is 


'A B 


P 0 ■ 


'A B 

0 / 


0 -P 


0 / 


'C D 

* 

y 0 ■ 


C D 

0 I 


0 -Y 


0 I 


^ 0 , 


Since Y 0, by left and right multiplying to the 

above expression, we can recover ||< 1, 
which is a scaled small gain test. 

Finally, for Example fTOl we have f(V) = Tr (HU), and 
/* (y) — 2 /n, where the domain is . In this case, condition 
dl becomes 


A* PA - P A* PB 
B*PA B*PB 


C D 
0 / 



D 

I 


-< 0 . 


For block diagonal structure, such as Example [8] we can 
also apply our approach to recover the block diagonal small 
gain test as in [18]. 

From robust control theory, we know that the scaled small 
gain test provides a sufficient and necessary test for robust 
stability in certain cases [1]. In fact, all the examples we 
provide fall in to those classes. Notice that we have shown 
that the scaled small gain test is a necessary and sufficient 
condition for clt/ fl ]HI_|_ = 0. Therefore, we obtain the 
following chain of equivalent statements when the scaled 


























































































small gain test becomes the equivalent condition for the Proposition 10: Suppose p{A) < 1. Then, for any matrix 
robust stability of G. norm || • ||, ||^^|| G h. 


clClnH+ = 0^ ||0-^G0||oo < 1 

^ Robust stability of G 

However, proving (b) from the scaled small gain test is 
not a trivial task whereas (a) is from a standard machinery. 
We strongly believe that there exists a direct proof between 
(clC/ n H+ = 0)<:^(Robust stability of G) in the style of 
[21] without relying on the complicated argument, and this 
is currently under investigation. 

Another important observation is that if cl C/ fl IHI+ 0, 
then we can use SDP to find such a V. Then using Lemma 
[T] we can find a pair (w, z) that approximately satisfies 

z = Gw 
w = Az. 

Notice that this pair (w, z) disproves the robust stability. 

In conclusion, we have shown how our main result can be 
used to derive the scaled small gain test without using the 
commutant, 0. Moreover, we show that the exact implication 
of the scaled small gain test, clQ n IHI+ = 0, using our 
results. This suggests that there may exist deeper connection 
between robust stability and the set relationship cl C/011+ = 
0, and we are currently investigating their exact relationship. 

VI. Conclusion 

In this paper, we propose an alternative, reverse direction 
of theoretical development for robust control theory. Based 
on our Lemma[T] an SDP representation of a set of gramians, 
we show that the robust analysis and stability question can be 
directly formulated as a primal optimization. Moreover, we 
show that the well-known results in robust control theory can 
be obtained via SDP duality, an arguably simple machinery 
to prove many interesting results, and this shows that our 
approach is a primal formulation of robustness analysis. 
Therefore, we believe that our paper provides an alternative 
’’primal-dual” picture in robust control theory, and this new 
development not only opens up the new research direction, 
but also enhances pedagogy. 

VII. Appendix; Proof of the main result 

This section we present the main proof of our proposition 
[T] with technical lemmas that need to prove our result. 

A. Preliminaries from linear algebra 

The following results from the linear algebra are used to 
prove the main result. 

Proposition 9: For x,y € C", ||a;y*l|i;’ = ||a:|| 2 ||t/|| 2 - 

Proof: \\xy*\\j, = Tr{{xy*)*{yx*)) = \\x\\l\\y\\l ■ 

Theorem 5 (Gelfand, 1941): For any matrix norm || • ||, 
lim \\A-\\^/- = p{A). 

n—¥oo 


Proof: Let e = (1 — p(A))/2 > 0. Then from the 
Theorem |5] there exists TV S N such that 

||A'=||<(p(A) + e)^ 


for all k > N. 


Ells'll = 

k—O 

< 


N CO 

EP'^IK E Ill'll 

N CO 

E Ill'll + E 

fc=0 fc=iV+l 


Since p(A) + e < 1, the second term is finite. Therefore, 

m\^h. m 


Lemma 3 (Rantzer, 1996): Let F, G complex matrices 
with same dimension. Then FF* = GG* if and only if there 
exists a unitary matrix U £ such that F = GU. 


Proof: See [9]. ■ 

The following result about a convex cone C is a direct 
consequence of the above lemma, and the results states that 
extreme points of C are rank one matrices. 

Proposition 11 (Rank one decomposition): For all V G 

C, there exists a set of matrices Vi, • • • , Vn+m G C such 
that V = J2k=T Rank (14) < 1 for all k = 

1, • • • ,n + m. 


Proof: See [8]. 


B. Technical lemmas for the main result 

In this section, we derive technical results to prove the 
main result of this paper. The basic idea behind the following 
results is to bound the error terms arise in the proof of our 
main result. 


Proposition 12: Suppose w has finite number of non-zero 
entries. For any e > 0, there exists N G N, such that 

||A(Mw, w) - A„(Mw, w)||+ < 

for all n > N. 

Proof: Let x = Mw, and consider T £ N such that 
Wk = 0, for all k >T. For iV > T, we have 


II A(Mw, w) — A7v(Mw, w)|| + 


E A’^xriA^^XT)* 

k^N 


CO 

< E 

p k—N 


= ||A^a:r||^ Ells'll' 

k=0 


Since ||A ^||2 G h C h, the infinite sum is finite. In addition, 
from the Theorem |5] HA^cctHf — >■ 0 as A — )> c». Therefore 
by choosing N sufficiently large, we can conclude the proof. 






(15) 

(16) 


Proposition 13: Let x, w £ I 2 , and y € I 2 such that yk = 
^^ 2/0 for all k. Then there exists a constant C such that 

||A(x + y,w)-A(x,w)|| 

< Cmaxldxlloo + |lw||oo)||?/o|| 2 , llyoll^}- 


entries such that 

||A(Mw,w) — V\\f < £ 

A(w) = [^Oyn,n Im\ ^ [Om,n -^m] 


Proof: Notice that, 

||A(x + y,w) - A(x,w)||p, 


Xk + Uk 
Wk 


Xk + Vk 
Wk 


Xk 

Wk 



Xk 
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Wk 



Xk 

Wk 
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CXD 
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X) 

E2 

k^O 

00 - 

Y.‘^\\vkh^\\xk\\l + \\wk\\l + \\yk\\l 


Xk 

Wk 


Xk 

Wk 


V] \yk* 
0 


fc=0 


Since x, w £ Z 2 C I 2 , we have 

\/\\xk\\l + \\wk\\l < |x||oo + ||w||oo, 
for all k. Moreover, since yk = A^y^, we have 
||A(x + y,w) - A(x,w)||^ 


'V 2 


< ^2(|x|U + ||w|U)||A'=yo||2 + ||A* 

CXD 

< ^2(|x|U + ||w|U)||A'=|| 2 || 2 /o ||2 + ||A'=||2||yo| 


A;=0 


< Cmaxldxlloo + ||w||oo)||yo|| 2 , llyoll^} 

where C = 2||A'=||2 + ||A'=|||). Since ||A '=||2 e h C 

I 2 , C < 00 , and this concludes the proof. ■ 


C. Main result 

Now we are ready to prove main results of this paper. The 
main idea of the proof is as follows. 

Any rank one matrix in C can be generated by a sinusoid 
w, but a sinusoid is not in 12 - Therefore we find a signal in 
I 2 which approximates this sinusoid. This is not surprising, 
because in Hoc analysis [22], the so called worst case signal 
is sinusoid which is not in I 2 , so one has to approximate this 
sinusoid using I 2 and the supremum is not achieved. More 
fundamental reason for this is due to non-compactness of an 
unit sphere in I 2 , but we will not elaborate this point. 

For a full rank matrix in C, we firstly decompose this 
matrix to rank one matrices using the Lemma [TT] then 
approximate each rank one matrices by a signal in 12 - Finally, 
we pad them together to approximate a full rank matrix as 
in [18]. 

Proposition 14: Suppose V €C, and Rank (V) < 1. Then 
for all e > 0, there exists w with a finite number of non-zero 


Proof: Suppose Rank {V) = 0. Then V = 0 € C, and 
w = 0 satisfies ([TsT i and ([ThT l. 

Now suppose Rank {V) = 1. We will construct w which 
satisfies (US and (IThT l. Since Rank {V) = 1, there exists 


Xs £ C^,Ws £ C™ such that V = 


by defining / = [A i?] 


? 9 — \_kn 0n,m] 


. Moreover, 
, we 


can easily see that f f* = gg'^. Therefore from the Lemma 
|3l there exists 9 such that e^^Xs = Axs + Bws- 
Now, for a given £ N, define w 


Wk = 



if 0<k<N 
if N <k. 


It is easy to see that A(w) = XT=o WkW^ = 
Xk=o '^kW^ = WgW*. and therefore w satisfies (IThl l. In 
order to obtain x = Mw, let us define the following signal 
s, t 


Sk = 


1 p.jSk rj. 


, 1 Ak-N„ieN^ 

tk = - l^A’^Xs 

vW 


if 0<k<N 
if N < k, 


then X = s -f t. Notice that 

N-l r 

AAr(s,w) = 


k=0 

and this shows 
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N-l r 
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||A(s,w) - V\\f = 
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_ 1 
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< Eii-^ 


fc ||2 
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Mi 
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Cl 

Notice that Ci < 00 because of the Proposition [TO] 

Now using the triangle inequality and the Proposition HaI 
we obtain 


||A(x,w) - V\\f = ||A(s + t,w) - V\\f 

< |lA(s,w) - ^IIf + ||A(s + t,w) - A(s,w)||f 

< + Cmaxldslloo + ||w||oc)||fo||2, \\to\\l} 

Since ||s||oo = "y^ll^sll’ l|w||oo = P 0 II 2 = 

^llxsll, we have max{(|s||oo + ||w||oo)||fo|| 2 , ||io||i} = 
;^||a:s|| 2 (||a:s ||2 + ll^slb)- By combining all these bounds. 




















































































we can conclude that there exists a constant C 3 only depends 
on A, Xs, Ws such that 

||A(x,w) - V\\f < 

therefore by taking sufficiently large N, we can make w 
satisfy dEli, and clearly w has N number of non-zero entries. 


Now combining all these results, we are ready to prove 
our main result, the Proposition [T] Proof: [Proof of 
the Proposition [T1 From the Lemma [TT] we can decompose 
V = where Vi S C, and Rank (Li) < 1. Let 

us rearrange these terms, so that V = where 

Rank (Vi) = 1. We now use an induction on r. Suppose 
r < 1, then from the Proposition O the proof is done. 

Now assume the induction hypothesis holds, that is for 
£ C, there exists w with a finite number of non¬ 
zero entries such that 

A(Mw, w) 

r —1 

A(w) = ^ ^ [Om,n ^m\ Vi ^m\ 

Similarly, for 14, there exists w with a finite number of non¬ 
zero entries such that 

||A(Mw,w) - VrWp < iff, 

A(w) = [Om,n ^m\ Vr I'm\ 

satisfies with ff/4 and 2. In addition, since Vr G C and 
Rank(lA) = 1, from the Proposition [T4l there exists finite 
length w satisfies 1 with ff/4 and 2. 

Let r G N such that Wk = 0 for all k > T. From the 
Proposition [ 12 ] we can find A^i such that 

||A(Mw, w) - A„+t(Mw, w)|| < iff, 

for all n > Ni. 

Consider the following signal w 

Wk if 0<k<N + T 

Wk-N-T if N + T < k, 

where N > Ni. Clearly, w has a finite number of non-zero 
entries, and A(w) = A(w) + A(w), which shows 

A(w) = fm\ V fm] 

Now, let X = Mw, X = Mw, and x = Mw. Then, 

{ Xk if 0 < fc < T 

ifT<fc<A^-fr 

Xk-N-T + A^~'^xt if N -\-T <k. 

Notice that 

A(x,w) = A 7 v+t(x,w) 

Xk -f XT 

Wk 

= A 7 v-i-t(x,w)- f A(x-f y,w), 


■E 


Xk 


A^A^ir 

Wk 







1 


where yk = A^A^xt- 
Therefore, 


||A(x,w) - V\\f 


< 


A 


N+T 


(x, w) - y. 


||A(x-f y,w) - VrWi 


< ||AAr+r(x,w) - A(x,W)||^-f 




2 = 1 


+ IIA(x -f y, w) - A(x, w)|lp. -f IIA(x, w) - y.||j 


< -e -f Cmaxldxlloo + ||w||oo)||yo||2, llyoll^}- 


Notice that x, w are given signals in I 2 , and does not depend 
on our choice N. However, since II 2 / 0 II 2 = ||4l^|| ||i||T can 
be made arbitrarily small by taking N ^ 00 , and this 
concludes the proof. ■ 
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